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ABSTRACT 

Objectives: The 'enhancing human resources and the 
use of appropriate technologies for maternal and 
perinatal survival in sub-Saharan Africa' (ETATMBA) 
project is training emergency obstetric and new-born 
care (EmONC) non-physician clinicians (NPCs) as 
advanced clinical leaders. Our objectives were to 
evaluate the implementation and changes to practice. 
Design: A mixed methods process evaluation with the 
predominate methodology being qualitative. 
Setting: Rural and urban hospitals in 8 of the 14 
districts of northern and central Malawi. 
Participants: 54 EmONC NPCs with 3 years' plus 
experience. 

Intervention: Training designed and delivered by 
clinicians from the UK and Malawi; it is a 2-year plus 
package of training (classroom, mentorship and 
assignments). 

Results: We conducted 79 trainee interviews over 
three time points during the training, as well as a 
convenience sample of 10 colleagues, 7 district 
officers and 2 UK obstetricians. Trainees worked in a 
context of substantial variation in the rates of maternal 
and neonatal deaths between districts. Training reached 
trainees working across the target regions. For 46 
trainees (8 dropped out of the course), dose delivered 
in terms of attendance was high and all 46 spent time 
working alongside an obstetrician. In early interviews 
trainees recalled course content unprompted indicating 
training had been received. Colleagues and district 
officers reported cascading of knowledge and initial 
changes in practice indicating early implementation. By 
asking trainees to describe actual cases we found they 
had implemented new knowledge and skills. These 
included life-saving interventions for postpartum 
haemorrhage and eclampsia. Trainees identified the 
leadership training as enabling them to confidently 
change their own practice and initiate change in their 
health facility. 



Strengths and limitations of this study 



This is the first study to take an in-depth look at 
training of non-physician clinicians in sub- 
Saharan Africa and the first to look at how this 
training is accepted by the trainees and how they 
then go on to implement this training into their 
practice. 

The results of the evaluation are very positive 
with trainees showing a high regard for the train- 
ing and demonstrating that the training has had 
a positive impact on their clinical practice. 
The results suggest that the training has enabled 
the lives of mothers and babies to be saved. 
Limiting factors are that while it appears that the 
trainees have made a difference, they are a small 
cohort and the impact on national maternal and 
neonatal mortality rates may be difficult to see. It 
is also possible in studies like this that trainees 
report what they consider socially acceptable to 
the evaluation team. However, reports of 'real' 
events suggest that this is not the case. 
This cadre is an important component in helping 
relieve the chronic shortages of trained medical 
professionals in sub-Saharan Africa and helping 
countries move towards realisation of millennium 
development goals. Further evaluations of the 
up-skilling of this cadre are needed. ^[ 



I 



Conclusions: This process evaluation suggests that 
trainees have made positive changes in their practice. 
Clear impacts on maternal and perinatal mortality are 
yet to be elucidated. 



INTRODUCTION 

Enhancing human resources and the use of 
appropriate technologies for maternal and 
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perinatal survival in sub-Saharan Africa (ETATMBA) is a 
European commission (FP7) funded project. In north- 
em and central Malawi it is providing advanced clinical 
and leadership training (between November 2011 and 
June 2014) to non-physician clinicians (NPCs) who 
provide emergency obstetric and new-born care 
(EmONC). 

A widespread crisis in the health workforce is affecting 
the realisation of health-related millennium develop- 
ment goals. ^ ^ There is also an imbalance in the range 
of health worker skills with many countries having too 
few specialist doctors such as surgeons, obstetricians and 
anaesthetists, relative to the health needs of their 
population. 

An important indicator of the global personnel short- 
age in the health sector is the proportion of women 
assisted by skilled birth attendants.^ In most industria- 
lised countries, skilled birth attendance is provided at 
almost all births while fewer than 50% of births in the 
majority of countries in South Asia and sub-Saharan 
Africa receive such support.* Estimates show that skilled 
birth attendance rates are only improving at less than 
0.5% per year: by 2015 it is likely that it will still be fewer 
than 50% of births where there is the support of a 
skilled birth attendant. ' 

To address the global health workforce crisis many 
countries are now considering task-shifting strategies. 
Task shifting from physicians to non-physicians appears 
to be both safe and effective in countries that have orga- 
nised and supported the extension of their maternal 
care in this way.''"^^ In Malawi, NPCs have been estab- 
lished health providers since 1976 performing surgical 
procedures, giving anaesthetics and providing medical 
care.^^ There are no clear career pathways for NPCs 
who are often undervalued.^ ' ^'^ Enhancing the skills of 
this cadre is a vital approach to improving healthcare for 
mothers and babies in sub-Saharan Africa where there 
are few medical doctors. The WHO has made recom- 
mendations to optimise the NPCs role in maternal and 
new-bom health.^' 

The evaluation of ETATMBA involves a cluster rando- 
mised controlled trial with process evaluation.'^ We 
report the process evaluation of the training. We report 
how the programme of training has been received and 
look for evidence that individual practice may have 
changed as a result.'^ 

The setting and intervention 

Fifty NPCs working in EmONC were drawn from eight 
districts in central and northern Malawi to undertake 
the training (see online supplementary appendix) . 

Briefly, the training package was a 30-month pro- 
gramme of knowledge and skills training including men- 
toring of practice. In addition, two obstetricians at 
specialist registrar level with 5 years of clinical experi- 
ence worked alongside the NPC, each for 2 weeks in 
each district, providing peer support and sharing skills 
and knowledge. Figure 1 contains a summary of the 



content of the training modules and further details are 
on the ETATMBA website^'* (see online supplementary 
appendix) . 

iVIETHODS 

We used a mixed methods approach for this process 
evaluation with the predominate data being qualitative 
(see table 1). 

Semistructured interviews were carried out at three 
time points. The first set of interviews was undertaken 
4-5 months after the delivery of module 1 with a con- 
venience sample of trainees. A researcher (WC) visited 
each intervention district for 1-2 days and interviewed 
ETATMBA trainees available during the visit. During the 
interviews, we asked the trainees about their perceptions 
of the training and support. With no prompting about 
training content we then asked them what new knowl- 
edge they gained. A researcher (WC) undertook the 
second set of interviews during 1-2-day visits to each 
intervention district 4—5 months after delivery of the 
second module on clinical leadership. We interviewed 
available trainees, asking them about training content 
and its implementation in their clinical work. We did 
this without prompting them. We then prompted them 
to talk about challenges and successes in using and 
sharing these skills in their facilities. We interviewed, 
during data collection visits, available district medical 
and nursing officers, exploring how they perceived the 
training and how it had fitted into their hospital. The 
researcher also asked the trainees to identify colleagues 
(cascadees) such as nurses, nurse midwives or NPCs to 
whom they had delivered some training. The researcher 
then sought interviews with available cascadees about 
the delivery and content of training they had received. 
Three researchers (WC, DRE and FG) carried out a 
third set of interviews with trainees, in an amendment to 
the protocol, while they were attending the week-long 
residential delivery of modules 5 and 6. We asked the 
trainees to provide specific examples of how they had 
used the training in their clinical work, describing actual 
cases. In the first part of the interview, we used no 
prompts about course content. In the latter part of the 
interview, trainees were asked to provide the examples 
from their clinical work of the application of each of the 
following key aispects of the training: delivery skills 
breech, vacuum extraction, caesarean section, neonatal 
resuscitation, management of postpartum haemorrhage 
(PPH), the use of partograms. At this time, we also inter- 
viewed the two obstetricians who had worked alongside 
the NPCs. 

Data were drawn from Malawi Ministry of Health 
(MOH) documents for describing the context of the 
trial.^' Data from the MOH data on the pool of NPCs 
from which recmits were selected in the intervention 
districts are used to describe the reach of the interven- 
tion. Dose delivered is assessed using attendance and 
assignment submission logs. 
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Timeline 


Modules & Research Activity 


Nov-Dec 2011 


Module 1: Clinical Officers as Advanced 
Leaders 

This concentrated on the five major causes of 
maternal mortality in Malawi, 

hypertension/eclampsia, postpartum 
haemorrhage, post delivery sepsis, sepsis after 
unsafe abortion, obstructed labour. 


Simulation and skill drills on emergency 
obstetrics included, external cephalic version, 
vaginal breech, postpartum haemorrhage, B 
Lynch suture, shoulder dystocia, eclamptic fit, 
vaccum extraction, obstructed labour 
(partograph) 


April - May 2012 


1^* interviews: N ^ 19 Trainees 


May -June 2012 


Module 2: Clinical service improvement and 
leadership in emergency obstetric and neonatal 
care 

Introduction to leadership 

Behaviours and leadership skills 

Leading and managing change 

Introduction to service improvement and problem 

identification 

Service improvement and values stream mapping 
Introduction to values based practice 


Key concepts in values based practice 
Introduction to Clinical Leadership Compentency 
Framework (CLCF) 

(trainees expected to use new leadership skills on 
return to district) 

Quality improvement in obstetrics 

Audit workshop (assignments given and audits 

conducted on return to districts (completion Nov 

2012) 

Neonatal care videos (eight training videos 
covering a variety of topics) 


%JCt — riO\ Z\)\Z 


2"^" Interviews: N = 12 Trainees, IN 


= 10 Caseadees, N = 7 DMO/DNO 


Nov-Dec 2012 


Module 3: Born too soon 
Neonatal survival in Malawi 
Essential and extra newborn care 
Gestational age 
Preterm neonatal resuscitation 


Special care of preterm babies 

Kangaroo mother care 

Evidence-based medicine 

Second and third trimester scanning technique 

Setting up the machine (ultrasound scanner) 


Dec 2012 -Feb 2013 


Module 4 "Professional project" involving a literature review, audit and re-audit. 


May -June 2013 


Module 5: Understanding research evidence 
and critical appraisal 

Training NPCs 

Introduction to evidence-based medicine 
Evidence-based medicine ovei'view 
Bias 

Interaction 

How to read an academic paper 
How to critically appraise an article 
Critical Appraisal Skills Programme 


Helsinki Ethical Principles for Medical Research 
National Health Services Research Committee of 
Malawi: Guidelines 

National Health Services Research Committee of 

Malawi: Application form 

Revised guidelines and operational procedures 

Qualitative research appraisal 

Qualitative research data analysis 

Statistics 




Module 6: Essentials of clinical training in 
obstetric and neonatal care in a low-resource 
setting 

Introduction to clinical education 
Clinical teacher briefing 
Learning styles and strategies 


How to teach practical skills 
Teaching practical skills 
On-the-job teaching 
Small group mentoring 
Interprofessional education 




3'^'' interviews: N =39 trainees, N = 2 Registrars 



Figure 1 An overview of the enhancing human resources and the use of appropriate technologies for maternal and perinatal 
sun/ival in sub-Saharan Africa (ETATMBA) training modules when they were delivered and the time points at which interviews 
were carried out. 



All interviews were audio recorded and transcribed 
verbatim. A study specific Nvivo (V.IO) project stored the 
transcripts and facilitated analysis. WC and DRE coded 
data with FG providing independent quality checks on 
20% of transcripts early in the coding process. We 
adopted a thematic approach for analysis. We based 
coding on the interview schedule and initial reading of 
the transcripts. We added additional codes as themes 
emerged from the data. The coding team discussed and 
agreed on themes and their definitions. We discussed 
coding discrepancies, and coding definitions were 
refined. For analysis we used a modification of the 
process evaluation framework proposed by Steckler and 



Linnan. We present our study process evaluation 
framework in table 1 . 

We extracted data relating to context from the MOH 
documents and present selected summary statistics to 
provide an illustration of the district. The officers from 
the MOH, who carried out the recruitment of the trai- 
nees, provided the overall numbers of NPCs from which 
they selected; a summary is provided. 

RESULTS 

We present the results mapped against our process 
evaluation categories. Where we provide brief illustrative 
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Table 1 Data sources and analyses approaches mapped against our adapted process evaluation framework 



Framework 



Description of frameworl( item Data source 



Analysis approacii 



Context 



Reach 



Dose delivered 



Dose received 



I 



Early 
implementation 




Later 

implementation 



Description of geographical 
location and summary of perinatal 
and maternal mortality in the 
intervention districts 
Description of the trainees and the 
pool of NPCs from which they 
were recruited 

Delivery of training sessions and 
training support 



Participation in training by NPCs 
and their perceptions of what they 
learn 



Malawi Ministry of Health data 



Malawi Ministry of Health data 



Course documentation 
Interviews with obstetricians who 
provided support 

Course attendance registers 
First set of interviews with 
opportunistic sample of 19 NPCs 



Implementation of initial learning in Interviews undertaken with an 



the NCP's own clinical working 
context particularly leadership 
skills 

Evidence of cascading of learning 
by NPCs 

Evidence of cascading of learning 
from the perspective of DMOs 

Implementation of training up to 
attending modules 5 and 6 



opportunistic sample of 12 NPCs 
from the seven intervention districts 
6 months after module 2 
Interviews with an opportunistic 
sample of 1 0 cascadees 

Interviews with an opportunistic 
sample of five DMOs 

Interviews with 39 NPCs when 
attending modules 5 and 6 



I 



Descriptive summary 



The distribution of trainees 
across the districts 

Interrogation of data for 
variation from intended delivery 
of training, for example, 
non-attendance 
Attendance counts 
Thematic analysis of NPC 
responses to question 'what 
did you learn that was new to ^ 
you?' i| 
Interrogation of interviews for 
spontaneously given examples 
of change in their working style 

Thematic analysis of what was 
taught by the NPCs to ^ 
cascadees V 
Interrogation of interviews for 
examples of cascading of 
training 

Thematic analysis of actual 
use of skills used by NPCs 



The opportunistic samples are based on the presence and availability (eg, not interfering with normal workload) of individuals at the time of 

the researcher's (WC) visit to the facilities. 

DM0, District Medical Officers; NPC, non-physician clinician. 



quotations from interviews, we identify the role and ID 
number of the interviewee, and where interviewees were 
interviewed more than once, we indicate whether it was 
interview 1, 2 or 3 (see online supplementary appendix 
for longer versions of quotations) . 

Context 

The NPCs receiving the intervention worked in hospitals 
in the following eight districts of Malawi: Lilongwe 
south, Nkhotakota, Ntcheu, Chitipa, Karonga, Mzimba/ 
Msusu, Kasungu and Rumphi. For the randomised con- 
trolled trial, the control districts were Lilongwe north, 
Dedza, Dowa, Mchinji, Ntchisi, Salima and Nkhata Bay. 
All districts have a district hospital; two also have a large 
central hospital (Lilongwe and Mzimba) and most have 
rural hospitals. Table 2, adapted from a 2011 Malawi 
MOH report,^^ provides a summary of the population, 
maternal deaths, stillbirths and neonatal deaths for each 
of the study districts. The districts are a mix of urban 
and rural with populations ranging from 172 000 to 
1 905 000 (median 397 000) . There is variance across 
the districts in terms of the number of deliveries each 
year, with institutional deliveries ranging from 5298 to 
53 426 (median 12 965). Maternal deaths range from 



3 to 48 (median 14), stillbirths range from 116 to 988 
(median 233) and early neonatal deaths (within 24 h of 
birth) range from 4 to 293 (median 100) with the peri- 
natal mortality rate (per 1000 deliveries) ranging from 
9.77 to 59.06 (median 24.7; see table 2).'^^ 

Reach 

Fifty-four trainees were recruited representing 67% 
(54/81) of the NPCs working in EmONC in the inter- 
vention districts. Of those recruited, 46 (85%) remained 
in the training programme at the time of the third inter- 
view, 25 from the central region of Malawi drawn from 
nine hospitals (district and central hospitals) and 21 
from the northern region drawn from six hospitals (dis- 
trict and central hospitals). One of the smaller districts 
in the northern region had one ETATMBA trainee 
working in its district hospital. Nearly all the trainees are 
men with only two women. Our sample frame of 
EmONC NPCs included 81 NCPs of whom four were 
women. 

Dose delivered 

Six modules (five taught and one professional project) 
had been delivered by the time we completed data 
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Table 2 An overview of the ETATMBA intervention districts showing population, maternal deaths, stillbirths and neonatal 
deaths 2010 









Maternal 


Maternal 






Perinatal 




District 


Number of 


deaths (all 


death rate 


Stillbirth 


Early 


mortality rate 


1 


population 


Institutional* 


facilities) 


(per 1000 


all 


neonatal 


(per 1000 




(1000) 


deliveries 


directt 


deliveries) 


facilities 


deaths^ 


dellverles)§ 


Northern region districts 














Chitipa 


179 


7177 


14 


1 .95 


133 


43 


24.62 


Karonga 


270 


"7/1 OO 


H A 
14 


1 .89 




-7-7 
1 1 


A A no ^1 

44. bl^ 


IVIzimba 


862 


<i/ by/ 




n "70 


A or\ 
43U 


I4U 


<:fU.0O 


Nkhata Bay 


216 


5298 


14 


2.64 


198 


115 


59.06 ^1 


Rumphi 


172 


8014 


5 


0.62 


116 


68 


23.00 ^1 


Central region 


districts 












H 


Dedza 


624 


17 751 


3 


0.17 


327 


113 


24.77 


Dowa 


558 


1 ^ 




1 

1 .oa 


C.0 1 




OP. 9Q 


Kasungu 


627 


16 824 


26 


1.55 


395 


99 


29.34 ■ 


Mchinji 


456 


16 800 


34 


2.02 


261 


100 


21.49 ■ 


Nkhotakota 


304 


8444 


14 


1.66 


156 


102 


30.55 ■ 


Ntcheu 


472 


16 065 


18 


1.12 


153 


4 


9.77 ■ 


Ntchisi 


225 


6934 


9 


1.30 


127 


24 


21.87 ■ 


Salima 


338 


11 536 


13 


1.13 


208 


107 


27.29 ■ 


Lilongwe 


1905 


53 426 


48 


0.90 


988 


293 


23.97 



Table adapted from Republic of Malawi Ministry of Health report; Malawi 2010 EmONC needs assessment final report. 
'Institutional deliveries — deliveries which take place in a health facility (not home births). 

tDirect complications and direct causes of maternal death include: antepartum haemorrhage (APH), postpartum haemorrhage, obstructed/ 
prolonged labour, ectopic pregnancy, severe abortion complications, retained placenta, ruptured uterus, postpartum sepsis, severe 
pre-eclampsia/eclampsia. Excludes 'other' direct complications or causes of death including non-severe abortion complications weighted for 
total number of health centres. 

:|:Early neonatal death was defined as a death occurring within 24 h after delivery. 
§Perinatal mortality rate=(stillbirths-i-v. early neonatal deaths)/(number of deliveries). 

ETATMBA, enhancing human resources and the use of appropriate technologies for maternal and perinatal survival in sub-Saharan Africa 



collection for this process evaluation (see figure 1). The 
two obstetricians from the UK spent 6 months each in 
Malawi: the first from January 2012 to June 2012 and 
the second from July 2012 to January 2013. They rotated 
to all intervention hospitals, where they worked with 
each trainee reinforcing the training received during 
modules. They supported the use of operative skills new 
to the trainees including undertaking transverse as an 
alternative to midline incision for caesarean sections 
and the use of B-Lynch sutures for PPH. They also sup- 
ported the use of all practical skills learnt through the 
course including the use of partographs, vacuum extrac- 
tion, neonatal resuscitation and antibiotic prophylaxis in 
caesarean section. 

Interviews with the trainees indicate that the obstetri- 
cian visits were valued, with many noting that the 
encouragement and support they received has helped to 
improve them as NPCs. 

Dose received 

All trainees attended module 1 (54/54). Five trainees 
withdrew before module 2, so 49/54 attended. An add- 
itional three withdrew between modules 2 and 3, so 46/ 
54 attended module 3. There was no more attrition for 
the remaining modules with all remaining trainees 
attending, with 46/54 attending modules 5 and 6 and 
completing the professional project. Reasons for 



withdrawal included the inability to find time for course 
work and switching to other courses. 

In all interviews with trainees we found them able to 
recall, unprompted, some components of the training 
modules. For understanding dose received, we report 
specifically on data from the first set of interviews with 
19 trainees. In later interviews the data on what they 
learnt did not add further to the analysis of the first set 
of interviews about dose received. However, as we report 
in subsequent sections, the later sets of interviews pro- 
vided insights about implementation. In these interviews 
trainees described receiving new learning on neonatal 
resuscitation (11/19 trainees); PPH (6/19), B-Lynch 
suture (5/19) and audit (5/19); management of breech 
delivery (2/19); cascading of their new knowledge to 
others (2/19); caesarean section (1/19); infection 
control (1/19); management of eclampsia (1/19). 

Early implementation 

The second set of interviews gives us insight into the 
early implementation of the new knowledge and skills 
the trainees had received. Here we focus on how the 
trainees work with and transmit new learning to others 
in their work place (see box 1). Of the 12 trainees inter- 
viewed, 10 talked about how the leadership training had 
helped them work better with those around them. 
District Health Officers reported that the trainees were 
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Box 1 Representative examples of the early implementa- 
tion of new skills and knowledge* 



Obstetrician support and example of skills recalled 
The number of C-sections was going up. . . teaching them vacuum 
extractions we wouid improve this... we used the Kiwi (vacuum 
extraction equipment). [Obstetrician 2] 
The attachment that we had of the obstetrician. . . we actualiy were 
abie to change from the routine way of doing things to real evi- 
dence based... [723:3] 

When we are resuscitating a new born we gave up very easily...! 
have learnt that time and improved l<nowiedge on how to resusci- 
tate a new born can mal<e a difference to the life of the baby. 
[T33:1] 

Representative examples of early implementation of skills and 
knowledge 

This course has really helped me to change the way I am interact- 
ing with my colleagues. . . We can start with the positives and end 
with the negatives, so that has really changed me, this is now 
how I work, both with my colleagues and the DHO. [T46: 2] 
DHOs 

I have seen a couple of them doing neonatal and maternal deaths 
audits and sharing those experiences with other health care 
workers. Also advocating for change in practice, change in atti- 
tude. They have taken a leading role to ensure that prenatal care 
scales up in this district. [DO 2] 
Cascadee 

...I also learnt as a new thing, clearly defined steps of how to do 
resuscitation of the baby [CA 1 0] 

/ see myself improving in these areas..., like vacuum extraction, 
the timing itself. . . the benefits of doing caesarean section when it 
is supposed to be done. [CA 5] 

That equipment, the Kiwi (vacuum extraction equipment), we 
were just leaving things because we didn't know how to use it 
These guys (the trainees) they helped us to use these things. 
[CA12] 

New techniques like the condom tamponade, it was quite new to 
me, at school we did not learn anything about condom 
tamponade. [CA 3] 

We didn't know that when somebody is suffering p re-eclampsia 
they gave her magnesium sulphate. . . but after the training now we 
have it in the labor ward. . . if it is needed we give magnesium sul- 
phate, then we refer the patient. . .[CA 14] 
Take the example of eclamptic case, everybody was afraid to use 
magnesium sulphate but now everybody is capable of using mag- 
nesium sulphate. [CA 6] 

In things like PPH (postpartum haemorrhage), 1 was trying to tell 
them memory is not good enough. When you want to remember 
something you put it on the wall so you don't have to memor- 
ise...! actually had to get them to write their posters and put it 
on the wail, so that you just look at it and you just remember 
[Obstetrician 1] 

/ remember they used get a nurse or an external speaker to come 
and teach them on a particular topic at the CPD (continuing pro- 
fessional development) session. After their training they decided 
they could use this particular session to cascade the training. 
[Obstetrician 2] 

He goes out orienting people on the use of vacuum extraction. . . 
he goes around in the health centres so the clinicians get skills 
from him. [DO 6] 

*The quotations here have been edited; fuller versions can be 
seen in the online supplementary material. 



taking leading roles in improving healthcare practice 
and cascadees indicate that trainees were sharing their 
knowledge and skills with those around them. Most com- 
monly reported, as having been taught, was neonatal 
resuscitation. Several cascadees reported improved 
understanding of the use of procedures they had been 
unfamiliar with and similarly one reported they received 
instruction on how to use equipment that until then had 
remained unused (vacuum extraction equipment). 
Several reported learning new techniques of managing 
PPH, including the use of the drugs misoprostol and 
oxytocin and the condom tamponade. The use of mag- 
nesium sulfate to manage pre-eclampsia was a learning 
experience for several cascadees. Cascadees also talked 
about the trainees sharing knowledge about infection 
control, including effective hand washing. 

In their interviews, the obstetricians mentioned 
encouraging or experiencing trainees cascading their 
learning and district officers described seeing evidence 
of trainees cascading what they had learnt to their 
colleagues. 

Later implementation 

We report from the interviews with 39 trainees in the 
third set of interviews. These provide evidence of how 
they used the various skills and knowledge from their 
training in clinical practice. We report data from the 
section of the interview where we prompted for data on 
each of the key aspects of the training. First, we report 
on the use of practical skills, then the use of audit skills. 
Finally, we report on the use of leadership skills, particu- 
larly when used in conjunction with practical skills 
learnt on the course. The subsections under each of the 
three headings are in frequency order with those dis- 
cussed the most at the top. 

Practical skills 

Twenty-eight of the 39 interviewees mentioned the train- 
ing about caesarean section, 26 mentioned using the 
transverse incision as a new skill. 

Twenty-seven trainees mentioned neonatal resuscita- 
tion as a skill they encountered in the training with 25 
giving examples of how they had used the skills in prac- 
tice. Seventeen indicated that they had cascaded the 
skill to their colleagues in their facilities. This was not a 
skill new to them but they described how the training's 
more systematic approach was previously lacking. Several 
trainees mentioned upgrading their knowledge about 
resuscitation and on the length of time to continue 
resuscitating a baby. 

Twenty-three trainees talked about skills in the man- 
agement of a PPH. Out of these, 19 trainees reported 
using the skills in practice. Six trainees had used aorta 
compression; five had used the B-Lynch suture; five had 
used the condom tamponade; and three had used miso- 
prostol. Two people mentioned coordinating efforts for 
the management of PPH. 
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Fourteen trainees mentioned the training had helped 
them realise the advantages of monitoring labour with 
the use of partograms. 

Thirteen people mentioned vacuum extraction as a 
skill they encountered in the ETATMBA training. Most 
of the trainees mentioned that though it was not a new 
skill, they had lacked expertise to perform it. The train- 
ing improved their skill and confidence. Three reported 
cascading the skill to their colleagues. Several trainees 
said their clinical judgement had improved as to 
whether to conduct vacuum extraction or not. For 
example, where a caesarean section would have been 
normal practice, vacuum extraction is now considered. 

Twelve trainees discussed learning about vaginal 
breech delivery skills but only two were able to cite 
examples of how they had used the skills. Several trai- 
nees indicated they had managed to cascade the skill to 
others. Trainees indicated that learning the skills for 
breech delivery helped reduce the number of caesarean 
sections (see box 2) . 

Audit 

Of the 39 trainees participating in the third set of inter- 
views, all had undertaken two audits and 35 mentioned 
audit as an important skill. Table 3 presents examples of 
audits and their outcome. 



Box 2 Representative examples of the implementation of 
skills and knowledge* 



^.one of our tutors came. They facilitated changing to the trans- 
verse type incision at our institution. It has been adopted... 
[T12:3] 

We used to have a lot of neonatal deaths because of poor skill of 
resuscitation before ETATMBA, because easily giving up... We've 
actually seen that the babies that we then used to say no, you can 
dispose, wait for it to die, have survived, actually very healthy 
babies. [T30:3] 

/ applied the B-lynch suture, with my colleague another ETATMBA 
trainee. . . we applied it and the patient actually, stopped bleeding. 
The patient actually went home, was discharged from the facil- 
ity... it gave me courage, and I did it and it actually saved a life. 
[T45:3] 

At this point in time, we are really following the partogram and 
we are really taking action on each and every deviation from the 
normal. Not only ETATMBA students but even the nurses. So we 
are working together now. [T32:3] 

. . . what we call a Kiwi vacuum extraction. . . So, patients who could 
have gone for caesarean section with prolonged labour, we are 
able to assist them with vacuum extraction. [T1 :3] 
We managed to cascade the training on breech deliveries... Now 
after the training, at least most of the nurses at the hospital are 
able to do this. [T35:3] 

Breech delivery, to me it was one of the most difficult scenarios 
encountered... But after going through this course we have learnt 
how toy... So, now we are able to deliver, the breech deliveries. 
[T28:2] 

*These quotations have been edited; fuller versions can be seen 
in the online supplementary material. ^^^^ 



Leadership 

Trainees talk with pride, excitement and enthusiasm 
about leadership training; about how it had helped 
them bring about changes in clinical care. For many it 
was a revelation that by taking a different approach they 
achieved so much. Trainees have developed a collabora- 
tive approach to working with colleagues, particularly 
the nurses, which was not there before; they felt empow- 
ered to approach management about issues including 
being strategic in seeking, finding or using resources. 
The visiting obstetricians comment positively of the 
impact of the leadership training (box 3). 

DISCUSSION 

The results of this process evaluation indicated that the 
educational intervention for NPCs was received by the 
NPCs attending the training and that the NPCs used 
the training to change their own clinical practice and to 
influence the clinical practice of others working in their 
health facility. All the NPCs interviewed were able to 
provide examples of actual cases where the use of their 
newly acquired clinical skills had made a difference to 
the outcome for mother or baby. They were particularly 
enthusiastic about the leadership training. They drew on 
this training when making changes to clinical practice in 
their health facility, when seeking to change the 
dynamic of teamwork towards a more collaborative 
approach and when redirecting the use of resources. 
Trial results will reveal if the changes reported result in 
a change in perinatal and maternal mortality in the 
districts. 

This study has demonstrated a willingness to change 
clinical practice in obstetrics resulting from the educa- 
tional intervention for NCPs. For such change a team of 
people have to assent to the change, including NCPs in 
obstetrics, NCPs in anaesthetics, midwives, district 
medical officers, pharmacy and laboratory staff. For 
example, changing from caesarean section for breech 
presentation to vaginal breech delivery requires a 
culture change for all hospital labour ward personnel, 
but it has the potential to save maternal deaths from 
complications of caesarean section and to save scarce 
healthcare resources that can be used to save the life of 
another patient. Some NCPs did not report implement- 
ing skills learnt that other NCPs had implemented 
within the timeframe of our evaluation. The educational 
intervention was a combination of 1-week lecture 
courses, emergency simulations, one-to-one clinical 
on-the-job training and leadership training. This was 
considerably more substantial than other existing, emer- 
gency obstetric, 3-day courses. ^'^ We suggest that this 
multifaceted educational approach to change clinical 
practice is a powerful and novel way of reducing the 
burden of maternal and neonatal mortality in 
sub-Saharan Africa. 

A number of published studies have examined the 
engagement of NPCs in surgical work. Three papers 
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Table 3 Examples of audits and the outcome of the audit reported by ETATIVIBA trainees at interview 



Audit topic* 



Example of audit outcome reported at interview 



Use of partographs 



IVlanagement of 
pre-eclampsia and 
eclampsia 

Postabortion care 



Trainee found that nurses/midwives were not completing the partograph routinely. After presenting 
audit findings at team meeting and providing training there was change in practice: 
So, what we see today is, any patient going to labour ward the nurse fiii out the labour graph, and 
record and monitor. They now see that the monitoring aspect has a bearing on the outcome [9:3] 
/ went to the DNO with my findings... most of the health centres don't have magnesium sulphate... 
they are afraid to give magnesium sulphate and they cannot order the drug. . . For this year I have 
not seen any death from eclampsia. . . we are able to manage them there because they are ^ 
stabilised (at the health centre) before they arrive (at the hospital) [T40:3] H 
Trainee noted that current system was chaotic and that there was a lacl< of instruments ^ 
(During the audit) in the pharmacy I found equipment, (lying unused)...! distributed It around the 
health centres...! conducted some training like to teach them how to do a vacuum extraction, how 
to take care of a vacuum extractor. . .for the instruments to stay longer. So, It has really given me a 
clue, of trying to check some things, doing this now and again as a way of improving sen/ices 
[T2:3] 

Another trainee's audit revealed patients were being sent for evacuations in theatre unnecessarily 
and so incurring unnecessary cost when MVAs were more appropriate 

...patients who were meant for MVA's were sent for evacuations in theatre. So, looking at the cost 
it was, actually the cost was high... just because maybe there wasn't enough equipment for 
MVA's, so I discussed that with the management and they bought some sets and we proceeded 
doing r\/IVA's [T32:3] 

An audit of neonatal services found high sepsis rates in neonates. Reporting findings back to the 
group had a positive impact on practice 

The sepsis (rate) has reduced by this time after the auditing [T1 2:3] ^| 
Audit found clinical staff were not following the step-by-step procedure for neonatal resuscitation 
and not documenting the procedure. After sharing the results of the audit and training of 
colleagues there was improvement in the following of the step-by-step procedure 
...previously probably we were not putting things in order and then with the ETATMBA students 
they have drilled us to follow each step... we are resuscitating step by sfep...[NMW cascadee] 
An audit revealed colleagues were not checking vital signs when patients were and the hospital 
did not have misoprostol for controlling the bleeding. After presenting to the management and 
colleagues the management agreed to stock misoprostol and he saw a change in practice in 
terms of checking for vital signs 
Another audit resulted in change in practice as follows: 

Every patient from now, whether from the health centre or not, if they can't get access for two IV 
(intravenous) lines they are able now to put even one at least, which Is ok. Instead of leaving the 
patient alone with the driver (of car bringing the patient to hospital), at least they are able from the 
health centres to send somebody to accompany the patient In case of any problems [T9:3] 
*Audit topics in descending order of frequency reported. 

ETATMBA, enhancing human resources and the use of appropriate technologies for maternal and perinatal survival in sub-Saharan Africa; 
MVA, manual vacuum aspirations. 



Neonatal sepsis 



Neonatal resuscitation 



I 



Postpartum 
haemorrhage 



I 



1 1 

il 

I 



report evaluation of additional training given to NPCs. 
All report that training NPCs in specific skills (not obste- 
trics or neonatal care) is feasible and that NCPs can 
safely perform surgical procedures with the right train- 
ing and support.^"' ^'^ None of these papers evaluates 
how the training is implemented into clinical practice. 
A study in 2010 reports interviews with NPCs undertak- 
ing gynaecological procedures in Malawi. The study 
found NCPs felt at ease performing operations but the 
study highlighted the need for training and support.^'^ 
A recendy reported trial of an intervention in Malawi 
covering the years prior to our study demonstrated an 
improvement in maternal and neonatal mortality 
rates. This intervention included quality improve- 
ment intervention at health facilities along with a partici- 
patory women's group community intervention. 



A limitation of our intervention is that it is limited to 
training NCPs who may not remain working in the same 
health facility. 

Process evaluations are increasingly important in the 
evaluation of health interventions to place the effective- 
ness/non-effectiveness of the intervention in context. 
The conduct of process evaluations is being established 
in Africa in maternal and child health research and eva- 
luations of HIV/AIDs programmes.^ Our process 
evaluation suggests there has been real change in the 
skills of these NPCs and an enhancement of the profes- 
sionalism of this group. However, changes in clinical 
practice may not yet be sufficientiy consistent to impact 
on perinatal and maternal mortality. The huge variations 
in mortality rates across districts at baseline may prove to 
be a confounding factor in translating our very positive 
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Box 3 Representative examples of the trainees using tlieir 
leadersliip sl<ills to improve practice in their facilities* 



We share. . . We work as a team. [T41 :3] 
Nurses were going through the training for newborn resuscita- 
tion...! was abie to organise a good area for resuscitation and 
iobby for more resource from the DHO. [T15:3] 
Some said no, they are not worldng because maybe they were 
worn out things (equipment). . . We lool<ed around and we found 
things here and there and actually we have now replaced them. 
[T14:3] 

We complain that we don't have blood in the laboratory... After 
this training, if a patient donates blood for a procedure, if we see 
that this patient do not require this blood, we keep it and channel 
it to a patient that may be in dire need of blood. [T23:3] 
/ wanted the relationship between them and other clinicians to 
improve so they would work as a team not as Individuals. . . The 
midwives would come to say "we never used to do these things 
with NPC's before, but you know they don't now wait to be called 
they come and check with us what is going on and we would tell 
them and we would discuss management". [Obstetrician] 
(I saw them) taking on some leadership roles because they were 
respected. They were actually doing their audits and some had 
results with them so they presented to the district health manage- 
ment team... (about) things that they wanted to change. 
[Obstetrician 2] 

*These quotations have been edited; fuller versions can be seen 
in the online supplementary material. ^^^^^^^ 

qualitative findings into sustainable reductions in mortal- 
ity rates but highlight the need to improve the quality of 
care with the cadre of health workers available. 

A limiting factor in this study may have been that trai- 
nees are likely to report what they consider to be socially 
acceptable to the evaluation team. However, they were 
reporting actual examples where lives had been saved, 
such cis preventing the death of a woman from PPH, 
and provided detail that suggested these events had actu- 
ally happened. However, the trainees are likely to 
remember and report these dramatic events, but these 
events may be rare. Our assessment of the cascading of 
training was limited as we only interviewed cascadees 
who had received training. These limitations caution us 
that the results of the clinical trial may not be as positive 
as the interview accounts suggest. 

During the delivery of the intervention, over time, 
there was concurrent delivery within the districts 
involved in this trial (intervention and control districts) 
of other training initiatives from non-government orga- 
nisations for all relevant health professionals on neo- 
natal resuscitation. This is likely to improve perinatal 
outcome in intervention and control districts and is a 
confounding variable to the trial results. 

Task shifting in countries like Malawi is at present 
necessary for the provision of healthcare. NPCs provide 
and are likely to continue to provide the majority of 
healthcare for low resource countries in much 
of sub-Saharan Africa. Here we have evaluated a model 
of training for these clinicians with an emphasis on 



problem solving through leadership, audit and service 
improvement. During the process of developing and 
establishing the training it became clear that raising the 
status and quality of the educational experience through 
accreditation was a vital strategy. In Malawi, this 
approach has now been extended to train a further 60 
NPCs in obstetrics and five other specialties, supported 
by the Malawi MOH, College of Medicine and faith- 
based organisations. While much remains to be done, 
shared leadership training that empowers NCPs to 
produce clinical service improvement has potential to 
improve the health of mothers and babies in Africa. 
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